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Abstract 


In this paper, a computational method based on parameterizing state and 
control variables is presented for solving Stochastic Optimal Control (SOC) 
problems. By using Chebyshev wavelets with unknown coefficients, state 
and control variables are parameterized, and then a stochastic optimal 
control problem is converted to a stochastic optimization problem. The 
expected cost functional of the resulting stochastic optimization problem 


is approximated by sample average approximation thereby the problem can 
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be solved by optimization methods more easily. For facilitating and guar- 
anteeing convergence of the presented method, a new theorem is proved. 
Finally, the proposed method is implemented based on a newly designed 
algorithm for solving one of the well-known problems in mathematical fi- 
nance, the Merton portfolio allocation problem in finite horizon. The simu- 


lation results illustrate the improvement of the constructed portfolio return. 
AMS subject classifications (2020): Primary 93E20; Secondary 91G80, 91G10. 
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1 Introduction 


Most practical problems in various fields, such as economics and finance, lead 
us to solve continuous finite-horizon Stochastic Optimal Control (SOC) prob- 
lems. These problems are driven by Stochastic Differential Equations (SDEs) 
in mathematical finance and especially in portfolio management, which is 
started with classical equations such as Merton [10]. 

The solution of an SDE requires the evaluation of stochastic Ité integral 
i. S(u)dB(u), where {B(t)}; > 0 is a Brownian motion and S is a stochas- 
tic process. The common methods for evaluating of the integral, are direct 
numerical ideas [13]. For example, the approaches of [20, 3] use an optimal 
wavelet approximation of the Browning motion {B(t)}, > 0. Also, the ap- 
proaches of [30, 23, 22] apply the Legendre wavelets to compute numerical 
solutions of integral and differential equations. For instance, in [22], coeffi- 
cient functions of the SDE are approximated in terms of Legendre wavelets. 
Then according to the relation between the block pulse functions and the Ito 
integral of this function, the integrals of the coefficient function are approxi- 
mated. 

The most common approach for solve SOC problems is the indirect 
dynamic programming approach in which the corresponding Hamiltonian— 
Jacobi-Bellman (HJB) equation has to be considered [14, 27, 33]. However, 


the second-order partial differential HJB equation is usually solved under 
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some prior assumptions, and it is not solvable analytically in most cases, 
which is why applying appropriate numerical ideas can be applicable to de- 
sign optimal decision (control) rules. Among the numerical ideas, the direct 
ones are more common methods. In these methods, the dynamical system 
under consideration is discretized in space and time domain, based on the 
application of the Markov chain. For example, the presented methods of 
(17, 31] obtain the transition probabilities of the Markov chain from the HJB 
equation by using finite difference and finite-element ideas. Also, there are 
some approaches that apply approximation schemes to SOC problems. For 
instance, the approaches of [4, 16] are Markov decision chain methods from 
the original SOC problem by approximating the solution of the correspond- 
ing SDE and then solving the resulting Bellman equation by using value 
iteration. Additionally, Huschto and Sager [9] utilized the Wiener chaos ex- 
pansion developed by Ledoux [19] to reformulate the original SOC problem 
as a deterministic optimal control problem. Indeed, the considered stochas- 
tic process is expressed in terms of deterministic coefficient and orthonormal 
basis polynomials spanning the underlying Wiener chaos space. Therefore, 
the approach of [9] is a direct numerical method based on using orthonormal 
polynomials to solve SOC problems. For this purpose, wavelet polynomials 
can be used, because they have the property of local approximating dis- 
continuous functions [29]. For example, Haar wavelet orthogonal functions 
[26], Legendre wavelets [30], and Chebyshev wavelets [35] can be applied to 
SOC problems, and then the resulting parameterized problems can be solved. 
Indeed, the application of wavelets as a basis function in a numerical solu- 
tion of integral equations and optimal control have been attended recently 
(29, 1, 32]. In comparison with other algorithms, the wavelets techniques 
provide very fast algorithms. This is because of specific properties when it 
is used as a basis function. In fact, the wavelets techniques convert SOC 
problems to stochastic optimization (SO) ones [21, 2, 8] that can be solved 
by using common methods of SO problems. These methods are commonly 
divided into two categories, solution methods for single-stage problems and 
multistage problems [8]. These methods minimize or maximize an expected 
objective function due to random variables in the formulation of stochastic 


problems. There are four well-known solution methods, sample average ap- 
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proximation (SAA) [8, 5], stochastic approximation [18], response surfaces 
[34], and metamodels [6]. 


In this paper, a new direct numerical method based on using Chebyshev 
wavelets is applied to solve SOC problems. For this purpose, stochastic state 
and control processes are approximated by the finite series of Chebyshev 
wavelet polynomials. The resulting Chebyshev approximation is the best 
approximation for the continuous state and control variables. Chebyshev 
wavelets are well-behaved basic functions that are orthonormal on the inter- 
val [0,1]. The advantages of Chebyshev wavelets are that the values of the 
degree of polynomial M and the number of subintervals 2* are adjustable. 
Therefore, it can yield a more accurate approximation than piecewise con- 
stant orthogonal functions. Thereby, stochastic state and control processes 
and the expected cost functional of the SOC problem are parameterized. 
Therefore, the SOC problem is converted to an SO problem. The result- 
ing SO problem is a single-stage problem. Thus, the parameterized expected 
cost functional is approximated by sample average approximation thereby the 
problem is formulated as a deterministic optimal control problem, which can 
be solved by optimization methods more easily. Also, the proposed method 
does not require operational matrix that is an obstacle for works which use 
Chebychev wavelets to convert a differential equation into an algebraic one. 
Additionally, to solve an SOC problem by the proposed method does not 
require to solve a partial differential HJB equation, which is a limitation 
for solving SOC problems, whereas the optimal trajectory and optimal con- 
trol are approximated properly. The convergence of the proposed method 
is proved through a new theorem. Finally, the proposed method is imple- 
mented for solving one of the well-known problems in mathematical finance, 
the Merton portfolio allocation problem in finite horizon. The simulation 


results illustrate the improvement of the constructed portfolio return. 


This paper is organized as follows: The mathematical preliminaries of the 
proposed method are presented in section 2. The Chebyshev wavelet-based 
method is presented in section 3. The Merton portfolio allocation problem 
as an application of the proposed method is simulated in section 4. Finally, 


the conclusion is presented in section 5. 
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2 Mathematical preliminaries 


2.1 Formulation of a stochastic optimal control problem 


Assume that {Xz} +ej0,7] is an n-dimensional stochastic process within the 
probability space (Q,,IR) and that {B;}+j0,7] is a d-dimensional Brownian 
motion. The finite-horizon SOC problem is defined as follows [28]: 


ie 
min, Bf L(X;z, uz)dt + G(T, Xr), (la) 
0 
S.t. aX; = b(X:, uz) dt + o(Xz, uz)dBz, (1b) 
XG), (1c) 


The process {X;¢}1ej0,7) in L?(Q x [0,T]) is driven by controlled Ito stochas- 
tic differential equation (1b) with initial condition (1c). Also, 6 and o 
are describing the drift and diffusion parts of the random state process 
X, € R” for all t € [0,7], respectively. The stochastic control process 
{uz} = {u(w,t)}u,er» is chosen over a set A of admissible controls such 
that the cost function (la) be minimized. 

Additionally, the taken decision at time t € [0,7] depends on what al- 
ready has happened up to t. Therefore, the stochastic control process 
must be F;-adapted [12]. The admissible control functions can be cho- 
sen as “deterministic” controls u(t,w) = u(t), “open-loop” u(t, w) controls, 
which are nonanticipative with respect to the Brownian motion {B,} and 
“Markov” controls u(t,w) = uag(t, X(w)), where ua,(-) is a nonrandom and 
Lebesgue-measurable function. The process{X;} becomes an Ito diffusion 


under Markov control [25]. Also, the function u,;g must be smooth. 


2.2 Chebyshev wavelets 


In this subsection, Chebyshev wavelet polynomials are described, briefly. A 
family of wavelets can be constituted by dilation and translation of a function 


W called mother wavelet. 
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Consider the following family of continuous wavelet: 


t-— 
U,a(t) = |al-2v(-—_— 


), abeEeR,aF0, (2) 


where the dilation parameter a and translation parameter b are varying con- 
tinuously. The family of Chebyshev wavelets V,,,,(t) = U(k,n,m,t) is one 
of the applicable wavelets that is defined on interval [0,1] as follows [29]: 


k 
2 


Am2 k+1y, _ -1 <t< 2% 
Vam(t) = af Tm (2 € 2n + 1), gr SS t S OF (3) 
0, otherwise, 


where k € N and n = 1,2,3,...,2". Also, m =0,1,2,..., M—1 for M-order 
Chebyshev polynomials and 


(4) 


Additionally, T,,(t)’s in (3) are Chebyshev polynomials that can be con- 


structed by the following recursive relations: 


CB — Ta). 


3 Solving stochastic optimal control problem via 


Chebyshev wavelet-based method 


In this section, a proposed Chebyshev wavelet-based method for solving gen- 
eral SOC problems is presented. This procedure is presented in three subsec- 
tions. In subsection 3.1, stochastic state and control process are expanded in 
Chebyshev Wavelet polynomials. In subsection 3.2, the expected cost func- 
tion approximation is described. Finally, the convergence analysis of the 


method is proved in subsection 3.3 
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3.1 Chebyshev wavelet expansion of stochastic state and 


control process 


Let Q C C1[0,T] be the set of all piecewise-continuous functions with initial 
condition (1c) and let Qs 4-1 © Q be the class of combinations of Cheby- 
shev wavelet polynomials of degree up to (M — 1). 

Consider the Chebyshev wavelet approximations of state process {X¢}+¢[0,7] 


and control process {u;} as follows: 


2k M-1 
Ly wena, (6) 
n=1 m=0 
and 
; 2k M-1 
CH= YY, can Ven) (7) 


n=1 m=0 
Therefore, the SOC problem (1) can be interpreted as a stochastic minimiza- 
tion problem on Q. For this purpose, the interval [0,7] is divided to 2” 
subintervals; that is, 
k 


O71=, TU? STU UganT (8) 


Thus, the state variable (6) and the control variable (7) is rewritten as follows: 


fi) = 5 6 Gin Vien) (<fo27 
ox a(t = pro G2mVam(t), eT <t< ZT, ee 
fon (t) = i) tat Von) GT <t<T. 
Also, 
tt) = co CimYim(t), = OS ES HET, 
ne ta(t) = Liao Cam Bam) AT <t< Ar, ma 


iis enn Ve lO, Seo <teT 


m=0 Qk 


Now, from (9) and (10), the cost functional (1a) becomes 


T 
E[J(a10,-- +, @2km—1; C10) «++» Cok —1)] -z[f L(X,U)dt + G(T, Xr)|. 
0 
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In other words, we have 


Bld] = BL Je" Lea(0), ta )de + [Fp Lele), a(t) 


tet fake L(&ox (t), figs (t))dt + G(T, Box (T))}. a) 
Additionally, from (9) and (10), the controlled Ito SDE (1b) becomes 
X, = (%;, 0) +o(%, 0) By. (12) 
More precisely, the following constraints are yielded 
#1(t) = (41, t1) + o(f1, i) Ba, 
#2(t) = b(€2, tig) + o (#2, G2) Bo, (13) 


don (t) = b(£ox, tigk) + 0(&ox, fign) Bor. 
Also, according to the initial condition (1c), we have the following constraint: 


M-1 
S > dimW1m(0) — Xo = 0. (14) 
m=0 


According to the continuity property of the state variable and (8) for 
i= — ¢=1,2,...,2" —1, (15) 


one can yield 


eer) Q1m Vim(ta) = Mo) @am Yom(t); 
yo Gam Vim (te) = Sr in5 Gam Van (te), (16) 


M-1 M-1 
Vane0 gk —1mV2k—1m(tor-1) = Poe: Aton, Yakm(tar—1): 


According to the SOC problem (1) and the parameterization process, which 
was mentioned above, the following SO problem with objective function (11) 
subject to constraints (13)—(14) and (16) is designed, which can be solved by 
SO methods [8, 18], more easily. 


min E[J (at, 7%, Bs], (17a) 
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subject to : Plat, ye, Bi]? = C, (17b) 
where a = [a10,---; @1m—2,420,---,@2M-1,---,@gk0,-+-,@2eu_1; 
Y = [c1o,---,C1m—2,C20,---,C2M—1,---)C2k0,---,Coem—i] and {B;} is the 


Brownian motion. 


3.2 Expected cost function approximation 


Consider the SO problem (17). Let R?**1!™ be the domain of all the feasi- 
ble decisions and let (a;, 4) = ¥ be a specific decision. The goal is to find 
a decision that minimizes the cost function, J. Let the Brownian motion 
{€} denote random information that is available only after a taken deci- 
sion. Since we cannot directly optimize J (¥,€), we compute minimize the 
expected value, EF [J (¥,€)]. SAA is the most common approach of a choice 
for the approximation of FE Bi (4,€)]. The first step in SAA is sampling. let 
{&1,.-.,;&n} be a set of independent identically distributed realizations of ran- 
dom process {€;} and let J(a;,%,€;) be the cost function realization for &;. 
According to the SAA approach, the expected cost function is approximated 


by the average of the realizations: 
‘ jg 
BUX, 8) © — DY /I(X,&).- (18) 
i=1 
The second step in SAA is the solving an optimal problem. The right-hand 


side of (18) is deterministic, so deterministic optimization methods can be 


used for solving the following approximated problem for all n € N: 


. Ae 
Bh = MIN (ar qyenrrim ELI (ae, 1, §)] = minyeprrim — S7 F(4,&). (19) 
i=1 


Deterministic search is the main benefit of SAA [8]. 


3.3 Convergence analysis 


In this section, the convergence of the proposed method is investigated. 
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Theorem 1. Suppose that f(a) € L?[0,1] with bounded second derivative 
\f| < L, and let ro peo CnmUnm(2x) be its infinite Chebyshev wavelet 


expansion. Then 
(2m) L 


(2n)? (m2 — 1) 
This means that the Chebyshev wavelets series converges uniformly to f(x); 
that is, 


(20) 


lCnm| < 


= naa): (21) 


n=1m=0 


Proof. See [7]. 


Theorem 2. Let 6 = infix uye@ E[J]- If Bor m1 = infix,wyeq,.,,_, HlI(X, 4) 
fork, M =1,2,..., where Qox,7_ 1 is a subset of Q, then limg woo Bory_1 = 


B. 


Proof. Since (Xz, uz) € Qeeys_1, by considering the Chebyshev expansions 


(6) and (7) for stochastic processes {X;} and {uz}, respectively, we have 


Borm—1 = MIN (a, 74.)ER2A+1M El J (at, Ve5€)]- (22) 


Now, let {&,...,&} be a set of independent identically distributed realiza- 
tions of random process {&} and let J (at, %;&) be the cost function real- 
ization for €;. According to the SAA approach, the expected cost function is 


approximated by the average of the realizations: 


ELF(a,7,6)] =F Hlans.60) (23) 
If we define 
. tens 
Bn okM—1 = MIN (q,y7)ER2k+1M 7 S- J(a, on Es (24) 
i=l 


then there exists an optimal value (a*, y*, €;) for 
le; j 
arg min{ — S- J(a, of &) : (a, of &) € a x R)}, (25) 
i=1 


such that 
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By okM—1 = +L ilo Oey si) (26) 


Also, one can conclude that there exists a corresponding optimal value 
(X*,u*) from argmin{+ 77, J(X,u) : (X,u) € Qoejy_1} such that 


Oia 2 tee (27) 


Furthermore, since Qoxay_1 © Qoryy, we have 


Broek = oe Je = miN(x,u)eQyk a, = = aoe J(X,u) (28) 


< MiN(X,u)EQox M-1 7 53 Tk, u) (29) 


i=l 


= Bn okM—1 (30) 


Therefore, for all k, M and n, we have B* ..,, < GB Since, the se- 


n,2* M—1" 
quence {§* ,,,,} is a nonincreasing sequence. Additionally, this sequence is 


upper bounded and therefore is convergent and this completes the proof. 


For implementing of the proposed method, Chebyshev Wavelet-based 
Method algorithm for solving SOC problems, is presented as follows: 


Chebyshev wavelet-based method algorithm for 


stochastic optimal control problems 


Input : SOC problem (1). 


Output : The approximated Stochastic optimal trajectory and approximated 


optimal control. 


Step 1 : Choose N, k, and M, and set i=1 
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Step 2 : Approximate the state and control variable by Chebyshev wavelet 


series from equations (9) and (10). 


Step 3 : Find an expression of EJ] from equation (11). 


Step 4 : Determine the set of equality constraints, by (13), (14), and (16). 


Step 5 : Consider a set of independent identically distributed realizations of 
Brownian motion {B,} and approximate the expected cost function 


E|J(a,y, B)| from (18). 


Step 6 : Determine the optimal parameters [a*, y*] by solving the optimization 
problem with the resulting cost function of Step 5 subject to (17b) and 
substitute these parameters into (9) and (10) to find the approximated 


optimal trajectory, approximated optimal control. 


Step 7 : Ift=WN go to Step 8 else set 2 =i +1 and go to Step 2. 


Step 8 : End. 


4 Simulation results 


In this section, one of the well-known problems in continuous-time finance, 
the Merton portfolio allocation problem, is considered for illustrating the 


advantages and efficiency of the proposed method. 


Example 1 (Merton portfolio allocation problem in finite hoziron[15]). Con- 
sider an investing process on time interval [0,7], and denote wealth at time 
t € [0,7] by W;. Also, suppose that this investing is started with a known 
initial wealth Wo. At time t, we must choose a fraction of wealth to invest in 


a (set of risky assets) stock portfolio U;(t) whereas the remaining fraction, 
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1—Uy/(t) is invested in a (the risk-free asset) bond . Additionally, the variable 
U2(t) is considered as wealth consumption value at time ¢t. Therefore, the 
control vector has two component, 0 < U;(t) < 1 and U2(t) > 0. 

Let the interest rate for risky and risk-free investment be R and r, re- 
spectively, such that 0 <r < R. Thus, the bond price b; and the stock price 


S; evolve according to the following Black-Scholes models: 


t 
a a, a = Rdt + odBy, (31) 


? 


where o is a real positive constant that denotes the volatility of S, and 
B, is a Brownian motion described. The objective is to find an optimal 
two-dimensional control vector (Ui (¢), U2(t)), which maximizes the following 


expected cost functional: 


E{J| = ef e 9! F(Ud(t))dt (32) 
0 
subject to 


dw, = “Ow, + Sw, — U2(t)at 


= [(1 — Ui (t))r + U, R|W,dt + U,(t)oW;dB, — U2(t)dt, 


(33) 


W(0) = Wo, (34) 

where 6 and F are discount rate and utility function, respectively. 
Consider the utility function F(U2(t)) = US (t),0 < a < 1. This problem 
is solved by the proposed method for k = 1, M = 3,r = 0.05,R =0.11l,a = 
0.5,8 = 0.11,Wo = 10° and o = 0.4 on the interval [0,1]. Therefore, the 


state and control variables are approximated as follows: 


a 2 1 

A t = = mW m t 5 O0<t< 90 

W(t) = w1( ) 2m=0 ay 1 ( ) i 2 (35) 
W(t) = ome: A2mVam(t), 2 < t < I, 

. in (t) =o timUim(t),  0<t<h, 

ty = 4 aia ate 1 f (36) 
tia (t) _ poe ComWVam(t), 2 < t < il, 
a 2 1 

“ t)= —9 dimVim(t), O0<t<s, 

7 ee en) 
b2(t) = ae dam WV2m(t), 2 <t<l, 


where 
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W(t) = [Wio(t), Vir (t), Vie(t), Voo(t), Var (t), Vo2(t)], 
a(t) 
(t) 


= [210, @11, 412, 420, G21, 422], 


Y = [c10, €11, C12, €20, €21, €22, dio, d11, di2, doo, dar, daz). 


From (35) and (36), the expected cost functional (32) is parameterized as 


follows: : 
a 2 
Bis) =B[ [Pore yates fre Stee (at). (38) 
0 2 
By substituting (35) and (36) into the SED equation (33) and applying the 
differential transformation “2 = t,B(t;,) [24], the following equality con- 


straints can be obtained: 


fon a [(1 _ ay)r + 0, R] wrt, + [to |r=1, te Br _ 01 (tr) =0,t, € {0, sh, 
(2 — [(1 — dg)r + G2 R)We)1H2, + [GoW] 11, th Br — b2 (te) = 0, te € (5, 1}. 
(39) 
The continuity of state variable must be satisfied at point t; = $. Therefore, 


the following equality constraint is considered as well: 
w1(t1) — W(t) = 0. (40) 
Also, from initial condition (34) another constraint is produced as follows: 
#1(0) — 10° = 0. (41) 


Now, consider a Brownian motion, B; ~ N(0,1). Let {B;(t,), B:(te), By(ts)} 
be a sample of random process B;. According to the SAA method, the 


expected cost functional (38) is approximated as 


3 
wy J (a,y,B (42) 


t=1 


Bl F(a, Y Bi) 


ee 


By maximizing (42) subject to constraints (39)—-(41), the optimal vector 
[a*, y*] is obtained. Therefore, the optimal approximated trajectory of wealth 
{W;,} and the optimal approximated control {U2(t)} can be obtained. The 


simulation results are shown in Figures 1 and 2. 


In the following, the simulation results based on presented method in this 


paper are comprised with the simulation result of method proposed in [11]. 
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6X! 0! Optimal Trajectory of Wealth 
; ; r ; 


Figure 1: 


108 The wealth trajectory 
1 


Figure 2: The wealth trajectory by method proposed in [11] 


The optimal trajectory of the wealth {W,} by the Chebyshev wavelet- 
based method and method proposed in [11] is given in Figures 1 and 2, 
respectively. Figure 1 shows that the Chebyshev wavelet-based portfolio in- 
creases the initial wealth value from 10°$ to 5*10!°$ while according to Figure 
2, the proposed method in [11] has increased it to 5 * 10°$. Therefore, from 
comparison point of view, the resulting portfolio of Chebyshev wavelet-based 


method has a higher return. 


5 Conclusion 


In this paper, a new Chebyshev wavelet-based algorithm, which is the state- 
control parameterization method for solving problems, has been presented. 
The state and control process were parameterized via orthogonal Chebyshev 


polynomial basis functions. Therefore, the SOC problem was converted to 
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an SO, and an optimal approximation of the solution was produced without 
requiring compute the operational matrix of the derivative. An advantage of 
the proposed method is that an SOC problem is solved without encountering 
a partial differential HJB equation. The convergence of the proposed method 
was proved via a new theorem. One of the well-known problems in mathe- 
matical finance, the Merton portfolio allocation problem in finite horizon, was 
simulated by the proposed method. The simulation results showed the capa- 
bility and efficiency of the proposed method in comparison with other similar 
works. For instance, the return of the constructed portfolio was improved by 


the proposed method. 


Acknowledgements 


Authors are grateful to there anonymous referees and editor for their con- 


structive comments. 


References 


[1] Aidoo, A-Y. and Wilson, M. A review of wavelets solution to stochastic 
heat equation with random inputs, Applied Mathematics, 6(14) (2015) 
2226-2239. 


[2] Aoki, M. Optimization of stochastic systems. Topics in discrete-time 
systems, Mathematics in Science and Engineering, Vol. 32. Academic 
Press, New York-London, 1967. 


[3] Ayache, A. and Taqqu, M.S. Rate optimality of wavelet series approx- 
imations of fractional Brownian motion, J. Fourier Anal. Appl. 9(5), 
(2003) 451-471. 


[4] Azzato, J.D. and Krawczyk, J. An improved MATLAB package for ap- 
prozimating the solution to a continuous-time stochastic optimal control 


problem, Working paper of the Victoria University of Wellington, 2006. 


[5] Cherukuri, A. Sample average approximation of conditional value-at-risk 
based variational inequalities, Optim. Lett. (2023) 1-26. 


Iran. J. Numer. Anal. Optim., Vol. 14, No. 1, 2024, pp 1-19 


Chebyshev wavelet-based method for solving various stochastic ... 


[6] Cinquegrana, D., Zollo, A.L., Montesarchio, M. and Bucchignani, E. A 
Metamodel-Based Optimization of Physical Parameters of High Resolu- 
tion NWP ICON-LAM over Southern Italy. Atmosphere 14(5), (2023) 
788. 


[7] Guariglia, E. and Guido, R.C. Chebyshev wavelet analysis, J. Funct. 
Spaces 2022, Art. ID 5542054, 17 pp. 


[8] Hannah, L.A. Stochastic optimization, International Encyclopedia of the 
Social & Behavioral Sciences, 2 (2015) 473-481. 


[9] Huschto, T. and Sager, S. Solving stochastic optimal control problems by 
a Wiener chaos approach, Vietnam J. Math. 42(1), (2014) 83-113. 


[10] Jadamba, B., Khan, A.A., Migérski, S. and Sama, M. eds. Deterministic 
and stochastic optimal control and inverse problems, CRC Press, Boca 
Raton, FL, 2022. 


[11] Kafash, B. and Nadizadeh, A. Solution of stochastic optimal control 
problems and financial applications, J. Math. Ext. 11 (2017) 27-44. 


[12] Kappen, H.J. Stochastic optimal control theory, ICML, Helsinki, Rad- 
bound University, Nijmegen, Netherlands, 2008. 


[13] Kloeden, P.E. and Platen, E. The numerical solution of stochastic dif- 
ferential equations, 3rd edn. Springer-Verlag Berlin Heidelberg, 2011. 


[14] Korn, R. and Korn, E. Option pricing and portfolio optimization: Mod- 
ern methods of financial mathematics, Vol. 31. American Mathematical 
Soc., 2001. 


[15 


Kraft, H., Meyer-Wehmann, A. and Seifried, F.T.. Holger, K., Dynamic 
asset allocation with relative wealth concerns in incomplete markets, J. 


Econom. Dynam. Control 113 (2020), 103857, 20 pp. 


[16 


Krawczyk, J.B. A Markovian approximated solution to a portfolio man- 
agement problem,ITEM. Inf. Technol. Econ. Manag. No. 1 (2001), Paper 
2, 33 pp. 


Iran. J. Numer. Anal. Optim., Vol. 14, No. 1, 2024, pp 1-19 


Yarahmadi and Yaghobipour 18 


[17] Kushner, H.J. and Dupuis, P. Numerical methods for stochastic control 
problems in continuous time, Second edition. Applications of Mathe- 
matics (New York), 24. Stochastic Modelling and Applied Probability. 
Springer-Verlag, New York, 2001. 


[18] Lan, G. and Zhou, Z. Dynamic stochastic approximation for multi-stage 
stochastic optimization, Math. Program. 187(1-2), (2021), Ser. A, 487— 
532. 


[19 


Ledoux, M. A note on large deviations for wiener chaos, Séminaire 
de Probabilités, XXIV, 1988/89, 1-14, Lecture Notes in Math., 1426, 
Springer, Berlin, 1990. 


[20] Lisei, H. and Soos, A. Wavelet approximation of the solutions of some 
stochastic differential equations, Fourth Joint Conference on Applied 
Mathematics. Pure Math. Appl. 15 (2004), no. 2-3, 213-223 (2005). 


(21 


Marti, K. Stochastic optimization methods, Springer-Verlag, Berlin, 
2005. 


[22] Mohammadi, F. A efficient computational method for solving stochastic 
It6- Volterra integral equations, TWMS J. Appl. Eng. Math. 5(2), (2015) 
286-297. 


[23] Mohammadi, F. and Hosseini, M. A new Legendre wavelet operational 
matrix of derivative and its applications in solving the singular ordinary 


differential equations, J. Franklin Inst. 348(8), (2011) 1787-1796. 


[24 


Odibat, Z., Erturk, V.S., Kumar, P., Ben Makhlouf, A. and Govindaraj, 
V., An implementation of the generalized differential transform scheme 
for simulating impulsive fractional differential equations, Hindawi Math- 
ematical Problems in Engineering, 2022, Article ID 8280203, (2022) 11 
pages. 


[25 


@ksendal, B. Stochastic differential equations. An introduction with ap- 
plications,Sixth edition. Universitext. Springer-Verlag, Berlin, 2003. 


[26 


Pargaei, M. and Kumar, B.V. A 3D Haar wavelet method for a coupled 
degenerate system of parabolic equations with nonlinear source coupled 
with non-linear ODEs, Appl. Numer. Math. 185 (2023), 141-164. 


Iran. J. Numer. Anal. Optim., Vol. 14, No. 1, 2024, pp 1-19 


19 


[27] 


[28] 


[29 


[30 


[31 


[32 


33 


34 


35 


Chebyshev wavelet-based method for solving various stochastic ... 


Petkovi, N. and and Bozinovi¢é, M. The application of the dynamic pro- 
gramming method in investment optimization,Megatrend revija, 13(3) 
(2016) 171-182. 


Pham, H. Continuous-time stochastic control and optimization with fi- 
nancial applications, Stochastic Modelling and Applied Probability, 61. 
Springer-Verlag, Berlin, 2009. 


Rafiei, Z., Kafash, B. and Karbassi $.M. A new approach based on using 
Chebyshev wavelets for solving various optimal control problems, Com- 
put. Appl. Math. 37 (2018), $144-S157. 


Razzaghi, M. and Yousefi, S. The Legendre wavelets operational matrix 
of integration, Internat. J. Systems Sci. 32(4), (2001) 495-502. 


Simpkins, A. and Todorov, E. Practical numerical methods for stochastic 
optimal control of biological systems in continuous time and space, In 
2009 IEEE Symposium on Adaptive Dynamic Programming and Rein- 
forcement Learning, pp. 212-218. IEEE, (2009). 


Sohrabi, $. Comparison Chebyshev wavelets method with BPFs method 
for solving Abel’s integral equation, Ain Shams Eng. J. 2(3-4), (2011) 
249-254. 


Tourin, A. and Yan, R. Dynamic pairs trading using the stochastic control 
approach, J. Econom. Dynam. Control 37(10) (2013) 1972-1981. 


Yang, R., Li, W. and Liu, Y. A novel response surface method for struc- 
tural reliability, AIP Advances 12, (2022) 015205. 


Yang, Y., Heydari, M., Avazzadeh, Z. and Atangana, A., Chebyshev 
wavelets operational matrices for solving nonlinear variable-order frac- 


tional integral equations, Adv. Difference Equ. 2020, Paper No. 611, 24 
Pp. 


Iran. J. Numer. Anal. Optim., Vol. 14, No. 1, 2024, pp 1-19 


